Dataset statistics
| Number of variables | 22 |
|---|---|
| Number of observations | 89 |
| Missing cells | 285 |
| Missing cells (%) | 14.6% |
| Duplicate rows | 0 |
| Duplicate rows (%) | 0.0% |
| Total size in memory | 15.4 KiB |
| Average record size in memory | 177.4 B |
Variable types
| NUM | 13 |
|---|---|
| CAT | 7 |
| UNSUPPORTED | 1 |
| BOOL | 1 |
lpep_pickup_datetime has constant value "89" | Constant |
level_1 has a high cardinality: 88 distinct values | High cardinality |
VendorID has a high cardinality: 88 distinct values | High cardinality |
MTA_tax is highly correlated with Pickup_longitude | High correlation |
Pickup_longitude is highly correlated with MTA_tax | High correlation |
Tip_amount is highly correlated with Pickup_latitude and 1 other fields | High correlation |
Pickup_latitude is highly correlated with Tip_amount | High correlation |
Dropoff_longitude is highly correlated with Tip_amount | High correlation |
Payment_type is highly correlated with Lpep_dropoff_datetime and 2 other fields | High correlation |
Lpep_dropoff_datetime is highly correlated with Payment_type | High correlation |
Fare_amount is highly correlated with Payment_type | High correlation |
Tolls_amount is highly correlated with Payment_type | High correlation |
VendorID is highly correlated with level_1 | High correlation |
level_1 is highly correlated with VendorID | High correlation |
Payment_type is highly correlated with Lpep_dropoff_datetime | High correlation |
Lpep_dropoff_datetime is highly correlated with Payment_type | High correlation |
Extra has 66 (74.2%) missing values | Missing |
Tip_amount has 23 (25.8%) missing values | Missing |
Total_amount has 36 (40.4%) missing values | Missing |
Payment_type has 71 (79.8%) missing values | Missing |
Trip_type has 89 (100.0%) missing values | Missing |
level_1 is uniformly distributed | Uniform |
VendorID is uniformly distributed | Uniform |
Trip_type is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
Store_and_fwd_flag has 4 (4.5%) zeros | Zeros |
RateCodeID has 4 (4.5%) zeros | Zeros |
Pickup_longitude has 1 (1.1%) zeros | Zeros |
Pickup_latitude has 14 (15.7%) zeros | Zeros |
Dropoff_latitude has 13 (14.6%) zeros | Zeros |
Passenger_count has 3 (3.4%) zeros | Zeros |
Trip_distance has 47 (52.8%) zeros | Zeros |
Extra has 15 (16.9%) zeros | Zeros |
Tolls_amount has 5 (5.6%) zeros | Zeros |
Total_amount has 27 (30.3%) zeros | Zeros |
Reproduction
| Analysis started | 2020-12-31 01:52:16.830065 |
|---|---|
| Analysis finished | 2020-12-31 01:52:36.164247 |
| Duration | 19.33 seconds |
| Software version | pandas-profiling v2.9.0 |
| Download configuration | config.yaml |
level_0
Categorical
| Distinct | 2 |
|---|---|
| Distinct (%) | 2.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 712.0 B |
| 2 | |
|---|---|
| 1 | 5 |
| Value | Count | Frequency (%) | |
| 2 | 84 | 94.4% | |
| 1 | 5 | 5.6% |
Frequencies of value counts
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Histogram of lengths of the category
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
| Distinct | 88 |
|---|---|
| Distinct (%) | 98.9% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 712.0 B |
| 2015-11-01 00:57:34 | 2 |
|---|---|
| 2015-08-01 00:01:57 | 1 |
| 2019-09-01 00:10:53 | 1 |
| 2019-10-01 00:26:02 | 1 |
| 2015-07-01 00:01:10 | 1 |
| Other values (83) |
| Value | Count | Frequency (%) | |
| 2015-11-01 00:57:34 | 2 | 2.2% | |
| 2015-08-01 00:01:57 | 1 | 1.1% | |
| 2019-09-01 00:10:53 | 1 | 1.1% | |
| 2019-10-01 00:26:02 | 1 | 1.1% | |
| 2015-07-01 00:01:10 | 1 | 1.1% | |
| 2019-08-01 00:22:12 | 1 | 1.1% | |
| 2018-12-01 00:23:25 | 1 | 1.1% | |
| 2020-02-01 00:16:59 | 1 | 1.1% | |
| 2013-10-01 00:00:00 | 1 | 1.1% | |
| 2020-06-01 00:09:05 | 1 | 1.1% | |
| Other values (78) | 78 | 87.6% |
Frequencies of value counts
Unique
| Unique | 87 ? |
|---|---|
| Unique (%) | 97.8% |
Histogram of lengths of the category
Length
| Max length | 19 |
|---|---|
| Median length | 19 |
| Mean length | 19 |
| Min length | 19 |
| Distinct | 88 |
|---|---|
| Distinct (%) | 98.9% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 712.0 B |
| 2015-11-01 23:57:45 | 2 |
|---|---|
| 2018-03-01 00:22:02 | 1 |
| 2020-05-01 00:44:00 | 1 |
| 2015-10-01 00:56:03 | 1 |
| 2016-02-01 00:10:06 | 1 |
| Other values (83) |
| Value | Count | Frequency (%) | |
| 2015-11-01 23:57:45 | 2 | 2.2% | |
| 2018-03-01 00:22:02 | 1 | 1.1% | |
| 2020-05-01 00:44:00 | 1 | 1.1% | |
| 2015-10-01 00:56:03 | 1 | 1.1% | |
| 2016-02-01 00:10:06 | 1 | 1.1% | |
| 2019-07-01 00:29:50 | 1 | 1.1% | |
| 2017-12-01 00:40:22 | 1 | 1.1% | |
| 2016-01-01 00:39:36 | 1 | 1.1% | |
| 2017-06-01 01:39:52 | 1 | 1.1% | |
| 2016-11-01 00:50:48 | 1 | 1.1% | |
| Other values (78) | 78 | 87.6% |
Frequencies of value counts
Unique
| Unique | 87 ? |
|---|---|
| Unique (%) | 97.8% |
Histogram of lengths of the category
Length
| Max length | 19 |
|---|---|
| Median length | 19 |
| Mean length | 19 |
| Min length | 19 |
| Distinct | 1 |
|---|---|
| Distinct (%) | 1.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 712.0 B |
| N |
|---|
| Value | Count | Frequency (%) | |
| N | 89 | 100.0% |
Frequencies of value counts
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Histogram of lengths of the category
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
| Distinct | 4 |
|---|---|
| Distinct (%) | 4.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 712.0 B |
| 1 | |
|---|---|
| 5 | 7 |
| 4 | 1 |
| 2 | 1 |
| Value | Count | Frequency (%) | |
| 1 | 80 | 89.9% | |
| 5 | 7 | 7.9% | |
| 4 | 1 | 1.1% | |
| 2 | 1 | 1.1% |
Frequencies of value counts
Unique
| Unique | 2 ? |
|---|---|
| Unique (%) | 2.2% |
Histogram of lengths of the category
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
| Distinct | 50 |
|---|---|
| Distinct (%) | 56.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 75.06999729 |
|---|---|
| Minimum | -74.01079559 |
| Maximum | 264 |
| Zeros | 4 |
| Zeros (%) | 4.5% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | -74.01079559 |
|---|---|
| 5-th percentile | -73.96972504 |
| Q1 | 0 |
| median | 74 |
| Q3 | 145 |
| 95-th percentile | 260.8 |
| Maximum | 264 |
| Range | 338.0107956 |
| Interquartile range (IQR) | 145 |
Descriptive statistics
| Standard deviation | 108.5105896 |
|---|---|
| Coefficient of variation (CV) | 1.445458818 |
| Kurtosis | -0.8953076846 |
| Mean | 75.06999729 |
| Median Absolute Deviation (MAD) | 71 |
| Skewness | 0.2284766632 |
| Sum | 6681.229759 |
| Variance | 11774.54805 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) | |
| 264 | 5 | 5.6% | |
| 66 | 5 | 5.6% | |
| 255 | 4 | 4.5% | |
| 74 | 4 | 4.5% | |
| 92 | 4 | 4.5% | |
| 193 | 4 | 4.5% | |
| 97 | 4 | 4.5% | |
| 0 | 4 | 4.5% | |
| 42 | 3 | 3.4% | |
| 80 | 3 | 3.4% | |
| Other values (40) | 49 | 55.1% |
| Value | Count | Frequency (%) | |
| -74.01079559 | 1 | 1.1% | |
| -73.99118042 | 1 | 1.1% | |
| -73.98764038 | 1 | 1.1% | |
| -73.98733521 | 1 | 1.1% | |
| -73.97948456 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 264 | 5 | 5.6% | |
| 256 | 1 | 1.1% | |
| 255 | 4 | 4.5% | |
| 244 | 2 | 2.2% | |
| 236 | 1 | 1.1% |
| Distinct | 62 |
|---|---|
| Distinct (%) | 69.7% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 109.573833 |
|---|---|
| Minimum | 0 |
| Maximum | 265 |
| Zeros | 4 |
| Zeros (%) | 4.5% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 9.4 |
| Q1 | 40.72150803 |
| median | 74 |
| Q3 | 192 |
| 95-th percentile | 263 |
| Maximum | 265 |
| Range | 265 |
| Interquartile range (IQR) | 151.278492 |
Descriptive statistics
| Standard deviation | 85.47290806 |
|---|---|
| Coefficient of variation (CV) | 0.7800485364 |
| Kurtosis | -1.164983209 |
| Mean | 109.573833 |
| Median Absolute Deviation (MAD) | 55 |
| Skewness | 0.5436935547 |
| Sum | 9752.071136 |
| Variance | 7305.618012 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) | |
| 193 | 6 | 6.7% | |
| 0 | 4 | 4.5% | |
| 41 | 4 | 4.5% | |
| 264 | 3 | 3.4% | |
| 256 | 3 | 3.4% | |
| 49 | 3 | 3.4% | |
| 145 | 2 | 2.2% | |
| 129 | 2 | 2.2% | |
| 97 | 2 | 2.2% | |
| 14 | 2 | 2.2% | |
| Other values (52) | 58 | 65.2% |
| Value | Count | Frequency (%) | |
| 0 | 4 | 4.5% | |
| 7 | 1 | 1.1% | |
| 13 | 1 | 1.1% | |
| 14 | 2 | 2.2% | |
| 17 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 265 | 1 | 1.1% | |
| 264 | 3 | 3.4% | |
| 263 | 2 | 2.2% | |
| 256 | 3 | 3.4% | |
| 247 | 1 | 1.1% |
| Distinct | 25 |
|---|---|
| Distinct (%) | 28.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | -16.92781616 |
|---|---|
| Minimum | -74.01078033 |
| Maximum | 5 |
| Zeros | 1 |
| Zeros (%) | 1.1% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | -74.01078033 |
|---|---|
| 5-th percentile | -73.98213654 |
| Q1 | 0 |
| median | 1 |
| Q3 | 1 |
| 95-th percentile | 5 |
| Maximum | 5 |
| Range | 79.01078033 |
| Interquartile range (IQR) | 1 |
Descriptive statistics
| Standard deviation | 32.87896324 |
|---|---|
| Coefficient of variation (CV) | -1.942303894 |
| Kurtosis | -0.5968203748 |
| Mean | -16.92781616 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | -1.186332462 |
| Sum | -1506.575638 |
| Variance | 1081.026224 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=25)
| Value | Count | Frequency (%) | |
| 1 | 48 | 53.9% | |
| 5 | 12 | 13.5% | |
| 2 | 6 | 6.7% | |
| -73.95898438 | 2 | 2.2% | |
| -73.86499023 | 1 | 1.1% | |
| -74.00005341 | 1 | 1.1% | |
| -73.9841156 | 1 | 1.1% | |
| -73.92427826 | 1 | 1.1% | |
| -73.97253418 | 1 | 1.1% | |
| -73.95726013 | 1 | 1.1% | |
| Other values (15) | 15 | 16.9% |
| Value | Count | Frequency (%) | |
| -74.01078033 | 1 | 1.1% | |
| -74.00005341 | 1 | 1.1% | |
| -73.98732758 | 1 | 1.1% | |
| -73.9841156 | 1 | 1.1% | |
| -73.98394012 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 5 | 12 | 13.5% | |
| 2 | 6 | 6.7% | |
| 1 | 48 | 53.9% | |
| 0 | 1 | 1.1% | |
| -73.83633423 | 1 | 1.1% |
| Distinct | 72 |
|---|---|
| Distinct (%) | 80.9% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 12.7542269 |
|---|---|
| Minimum | 0 |
| Maximum | 90.41 |
| Zeros | 14 |
| Zeros (%) | 15.7% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0.76 |
| median | 2.8 |
| Q3 | 40.66344833 |
| 95-th percentile | 40.81643906 |
| Maximum | 90.41 |
| Range | 90.41 |
| Interquartile range (IQR) | 39.90344833 |
Descriptive statistics
| Standard deviation | 18.7378246 |
|---|---|
| Coefficient of variation (CV) | 1.469146248 |
| Kurtosis | 1.915168236 |
| Mean | 12.7542269 |
| Median Absolute Deviation (MAD) | 2.67 |
| Skewness | 1.527077381 |
| Sum | 1135.126194 |
| Variance | 351.1060707 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) | |
| 0 | 14 | 15.7% | |
| 0.76 | 2 | 2.2% | |
| 0.72 | 2 | 2.2% | |
| 1.5 | 2 | 2.2% | |
| 40.66344833 | 2 | 2.2% | |
| 40.78588486 | 1 | 1.1% | |
| 40.72904587 | 1 | 1.1% | |
| 40.76037979 | 1 | 1.1% | |
| 40.69804382 | 1 | 1.1% | |
| 40.76064682 | 1 | 1.1% | |
| Other values (62) | 62 | 69.7% |
| Value | Count | Frequency (%) | |
| 0 | 14 | 15.7% | |
| 0.24 | 1 | 1.1% | |
| 0.51 | 1 | 1.1% | |
| 0.58 | 1 | 1.1% | |
| 0.67 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 90.41 | 1 | 1.1% | |
| 40.91221237 | 1 | 1.1% | |
| 40.84508896 | 1 | 1.1% | |
| 40.8260994 | 1 | 1.1% | |
| 40.8189888 | 1 | 1.1% |
| Distinct | 38 |
|---|---|
| Distinct (%) | 42.7% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 12.67640449 |
|---|---|
| Minimum | 1 |
| Maximum | 404.5 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 1 |
| Q1 | 2.5 |
| median | 6 |
| Q3 | 12.5 |
| 95-th percentile | 25.5 |
| Maximum | 404.5 |
| Range | 403.5 |
| Interquartile range (IQR) | 10 |
Descriptive statistics
| Standard deviation | 42.64503601 |
|---|---|
| Coefficient of variation (CV) | 3.364127109 |
| Kurtosis | 83.59811148 |
| Mean | 12.67640449 |
| Median Absolute Deviation (MAD) | 5 |
| Skewness | 9.011845796 |
| Sum | 1128.2 |
| Variance | 1818.599096 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=38)
| Value | Count | Frequency (%) | |
| 1 | 19 | 21.3% | |
| 5 | 6 | 6.7% | |
| 2.5 | 5 | 5.6% | |
| 6 | 5 | 5.6% | |
| 3.5 | 3 | 3.4% | |
| 20 | 3 | 3.4% | |
| 13.5 | 3 | 3.4% | |
| 3 | 3 | 3.4% | |
| 9 | 3 | 3.4% | |
| 11 | 3 | 3.4% | |
| Other values (28) | 36 | 40.4% |
| Value | Count | Frequency (%) | |
| 1 | 19 | 21.3% | |
| 1.5 | 1 | 1.1% | |
| 2 | 1 | 1.1% | |
| 2.5 | 5 | 5.6% | |
| 3 | 3 | 3.4% |
| Value | Count | Frequency (%) | |
| 404.5 | 1 | 1.1% | |
| 28.2 | 1 | 1.1% | |
| 28 | 1 | 1.1% | |
| 27.5 | 1 | 1.1% | |
| 26.5 | 1 | 1.1% |
| Distinct | 20 |
|---|---|
| Distinct (%) | 22.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.9204494382 |
|---|---|
| Minimum | 0 |
| Maximum | 14.35 |
| Zeros | 13 |
| Zeros (%) | 14.6% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0.5 |
| median | 0.5 |
| Q3 | 0.5 |
| 95-th percentile | 3.828 |
| Maximum | 14.35 |
| Range | 14.35 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 1.814723815 |
|---|---|
| Coefficient of variation (CV) | 1.971562738 |
| Kurtosis | 34.96111593 |
| Mean | 0.9204494382 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 5.323121676 |
| Sum | 81.92 |
| Variance | 3.293222523 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=20)
| Value | Count | Frequency (%) | |
| 0.5 | 57 | 64.0% | |
| 0 | 13 | 14.6% | |
| 0.09 | 2 | 2.2% | |
| 0.2 | 1 | 1.1% | |
| 4 | 1 | 1.1% | |
| 3.25 | 1 | 1.1% | |
| 5.24 | 1 | 1.1% | |
| 6.11 | 1 | 1.1% | |
| 3.57 | 1 | 1.1% | |
| 0.19 | 1 | 1.1% | |
| Other values (10) | 10 | 11.2% |
| Value | Count | Frequency (%) | |
| 0 | 13 | 14.6% | |
| 0.09 | 2 | 2.2% | |
| 0.19 | 1 | 1.1% | |
| 0.2 | 1 | 1.1% | |
| 0.49 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 14.35 | 1 | 1.1% | |
| 6.11 | 1 | 1.1% | |
| 5.24 | 1 | 1.1% | |
| 4.33 | 1 | 1.1% | |
| 4 | 1 | 1.1% |
| Distinct | 23 |
|---|---|
| Distinct (%) | 25.8% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 4.478089888 |
|---|---|
| Minimum | -15 |
| Maximum | 52 |
| Zeros | 3 |
| Zeros (%) | 3.4% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | -15 |
|---|---|
| 5-th percentile | 0.5 |
| Q1 | 0.5 |
| median | 0.5 |
| Q3 | 0.5 |
| 95-th percentile | 20.55 |
| Maximum | 52 |
| Range | 67 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 10.69723296 |
|---|---|
| Coefficient of variation (CV) | 2.38879371 |
| Kurtosis | 10.48827477 |
| Mean | 4.478089888 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 3.111339855 |
| Sum | 398.55 |
| Variance | 114.4307929 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=23)
| Value | Count | Frequency (%) | |
| 0.5 | 63 | 70.8% | |
| 0 | 3 | 3.4% | |
| 3.5 | 2 | 2.2% | |
| 12.5 | 2 | 2.2% | |
| 7.8 | 1 | 1.1% | |
| 45 | 1 | 1.1% | |
| 50.5 | 1 | 1.1% | |
| 42 | 1 | 1.1% | |
| 13 | 1 | 1.1% | |
| 15.5 | 1 | 1.1% | |
| Other values (13) | 13 | 14.6% |
| Value | Count | Frequency (%) | |
| -15 | 1 | 1.1% | |
| 0 | 3 | 3.4% | |
| 0.5 | 63 | 70.8% | |
| 3.5 | 2 | 2.2% | |
| 5 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 52 | 1 | 1.1% | |
| 50.5 | 1 | 1.1% | |
| 45 | 1 | 1.1% | |
| 42 | 1 | 1.1% | |
| 21.25 | 1 | 1.1% |
| Distinct | 27 |
|---|---|
| Distinct (%) | 30.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.9943820225 |
|---|---|
| Minimum | 0 |
| Maximum | 7.64 |
| Zeros | 47 |
| Zeros (%) | 52.8% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 1.26 |
| 95-th percentile | 4.44 |
| Maximum | 7.64 |
| Range | 7.64 |
| Interquartile range (IQR) | 1.26 |
Descriptive statistics
| Standard deviation | 1.649629404 |
|---|---|
| Coefficient of variation (CV) | 1.658949344 |
| Kurtosis | 3.4868427 |
| Mean | 0.9943820225 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 1.964365544 |
| Sum | 88.5 |
| Variance | 2.721277171 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=27)
| Value | Count | Frequency (%) | |
| 0 | 47 | 52.8% | |
| 0.5 | 13 | 14.6% | |
| 1 | 4 | 4.5% | |
| 4.44 | 2 | 2.2% | |
| 2.04 | 1 | 1.1% | |
| 2.5 | 1 | 1.1% | |
| 3 | 1 | 1.1% | |
| 2.56 | 1 | 1.1% | |
| 5.76 | 1 | 1.1% | |
| 3.11 | 1 | 1.1% | |
| Other values (17) | 17 | 19.1% |
| Value | Count | Frequency (%) | |
| 0 | 47 | 52.8% | |
| 0.01 | 1 | 1.1% | |
| 0.5 | 13 | 14.6% | |
| 0.7 | 1 | 1.1% | |
| 1 | 4 | 4.5% |
| Value | Count | Frequency (%) | |
| 7.64 | 1 | 1.1% | |
| 6.03 | 1 | 1.1% | |
| 5.76 | 1 | 1.1% | |
| 4.76 | 1 | 1.1% | |
| 4.44 | 2 | 2.2% |
| Distinct | 4 |
|---|---|
| Distinct (%) | 4.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 712.0 B |
| 0 | |
|---|---|
| 0.5 | |
| 6.12 | 2 |
| 5.76 | 1 |
| Value | Count | Frequency (%) | |
| 0 | 69 | 77.5% | |
| 0.5 | 17 | 19.1% | |
| 6.12 | 2 | 2.2% | |
| 5.76 | 1 | 1.1% |
Frequencies of value counts
Unique
| Unique | 1 ? |
|---|---|
| Unique (%) | 1.1% |
Histogram of lengths of the category
Length
| Max length | 4 |
|---|---|
| Median length | 3 |
| Mean length | 3.033707865 |
| Min length | 3 |
| Distinct | 9 |
|---|---|
| Distinct (%) | 39.1% |
| Missing | 66 |
| Missing (%) | 74.2% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 1.218695652 |
|---|---|
| Minimum | 0 |
| Maximum | 10.3 |
| Zeros | 15 |
| Zeros (%) | 16.9% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 1.71 |
| 95-th percentile | 5.902 |
| Maximum | 10.3 |
| Range | 10.3 |
| Interquartile range (IQR) | 1.71 |
Descriptive statistics
| Standard deviation | 2.471018017 |
|---|---|
| Coefficient of variation (CV) | 2.027592379 |
| Kurtosis | 8.525754497 |
| Mean | 1.218695652 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 2.817782614 |
| Sum | 28.03 |
| Variance | 6.10593004 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=9)
| Value | Count | Frequency (%) | |
| 0 | 15 | 16.9% | |
| 10.3 | 1 | 1.1% | |
| 1.26 | 1 | 1.1% | |
| 2.86 | 1 | 1.1% | |
| 1.95 | 1 | 1.1% | |
| 1.56 | 1 | 1.1% | |
| 6.24 | 1 | 1.1% | |
| 1.86 | 1 | 1.1% | |
| 2 | 1 | 1.1% | |
| (Missing) | 66 | 74.2% |
| Value | Count | Frequency (%) | |
| 0 | 15 | 16.9% | |
| 1.26 | 1 | 1.1% | |
| 1.56 | 1 | 1.1% | |
| 1.86 | 1 | 1.1% | |
| 1.95 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 10.3 | 1 | 1.1% | |
| 6.24 | 1 | 1.1% | |
| 2.86 | 1 | 1.1% | |
| 2 | 1 | 1.1% | |
| 1.95 | 1 | 1.1% |
| Distinct | 2 |
|---|---|
| Distinct (%) | 2.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 712.0 B |
| 0.3 | |
|---|---|
| 0 |
| Value | Count | Frequency (%) | |
| 0.3 | 64 | 71.9% | |
| 0 | 25 | 28.1% |
| Distinct | 52 |
|---|---|
| Distinct (%) | 78.8% |
| Missing | 23 |
| Missing (%) | 25.8% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 19.6219697 |
|---|---|
| Minimum | 1.7 |
| Maximum | 413.51 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 1.7 |
|---|---|
| 5-th percentile | 3.8 |
| Q1 | 7.3 |
| median | 10.13 |
| Q3 | 19.24 |
| 95-th percentile | 34.4625 |
| Maximum | 413.51 |
| Range | 411.81 |
| Interquartile range (IQR) | 11.94 |
Descriptive statistics
| Standard deviation | 50.05578864 |
|---|---|
| Coefficient of variation (CV) | 2.551007336 |
| Kurtosis | 61.55362179 |
| Mean | 19.6219697 |
| Median Absolute Deviation (MAD) | 5.285 |
| Skewness | 7.722510339 |
| Sum | 1295.05 |
| Variance | 2505.581976 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) | |
| 7.3 | 4 | 4.5% | |
| 3.8 | 4 | 4.5% | |
| 7.8 | 3 | 3.4% | |
| 4.3 | 3 | 3.4% | |
| 19.24 | 2 | 2.2% | |
| 13.3 | 2 | 2.2% | |
| 12.3 | 2 | 2.2% | |
| 5.8 | 2 | 2.2% | |
| 14.3 | 1 | 1.1% | |
| 6.24 | 1 | 1.1% | |
| Other values (42) | 42 | 47.2% | |
| (Missing) | 23 | 25.8% |
| Value | Count | Frequency (%) | |
| 1.7 | 1 | 1.1% | |
| 3.3 | 1 | 1.1% | |
| 3.8 | 4 | 4.5% | |
| 4.3 | 3 | 3.4% | |
| 4.8 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 413.51 | 1 | 1.1% | |
| 38.19 | 1 | 1.1% | |
| 36.2 | 1 | 1.1% | |
| 34.56 | 1 | 1.1% | |
| 34.17 | 1 | 1.1% |
| Distinct | 9 |
|---|---|
| Distinct (%) | 10.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 2.701685393 |
|---|---|
| Minimum | 0 |
| Maximum | 61.8 |
| Zeros | 5 |
| Zeros (%) | 5.6% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0.12 |
| Q1 | 1 |
| median | 1 |
| Q3 | 2 |
| 95-th percentile | 3.2 |
| Maximum | 61.8 |
| Range | 61.8 |
| Interquartile range (IQR) | 1 |
Descriptive statistics
| Standard deviation | 8.109760006 |
|---|---|
| Coefficient of variation (CV) | 3.001741071 |
| Kurtosis | 38.64100191 |
| Mean | 2.701685393 |
| Median Absolute Deviation (MAD) | 0.7 |
| Skewness | 6.032733735 |
| Sum | 240.45 |
| Variance | 65.76820735 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=9)
| Value | Count | Frequency (%) | |
| 1 | 39 | 43.8% | |
| 2 | 27 | 30.3% | |
| 0.3 | 13 | 14.6% | |
| 0 | 5 | 5.6% | |
| 61.8 | 1 | 1.1% | |
| 14 | 1 | 1.1% | |
| 4 | 1 | 1.1% | |
| 42.5 | 1 | 1.1% | |
| 21.25 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 0 | 5 | 5.6% | |
| 0.3 | 13 | 14.6% | |
| 1 | 39 | 43.8% | |
| 2 | 27 | 30.3% | |
| 4 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 61.8 | 1 | 1.1% | |
| 42.5 | 1 | 1.1% | |
| 21.25 | 1 | 1.1% | |
| 14 | 1 | 1.1% | |
| 4 | 1 | 1.1% |
Ehail_fee
Real number (ℝ)
| Distinct | 20 |
|---|---|
| Distinct (%) | 22.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 3.91494382 |
|---|---|
| Minimum | -15 |
| Maximum | 52.8 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | -15 |
|---|---|
| 5-th percentile | 1 |
| Q1 | 1 |
| median | 1 |
| Q3 | 2 |
| 95-th percentile | 17.016 |
| Maximum | 52.8 |
| Range | 67.8 |
| Interquartile range (IQR) | 1 |
Descriptive statistics
| Standard deviation | 8.67607383 |
|---|---|
| Coefficient of variation (CV) | 2.216142614 |
| Kurtosis | 16.51451812 |
| Mean | 3.91494382 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 3.608597201 |
| Sum | 348.43 |
| Variance | 75.2742571 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=20)
| Value | Count | Frequency (%) | |
| 1 | 65 | 73.0% | |
| 2 | 6 | 6.7% | |
| 8.8 | 1 | 1.1% | |
| 7 | 1 | 1.1% | |
| 9.75 | 1 | 1.1% | |
| 45 | 1 | 1.1% | |
| 15 | 1 | 1.1% | |
| -15 | 1 | 1.1% | |
| 11.8 | 1 | 1.1% | |
| 9.36 | 1 | 1.1% | |
| Other values (10) | 10 | 11.2% |
| Value | Count | Frequency (%) | |
| -15 | 1 | 1.1% | |
| 1 | 65 | 73.0% | |
| 2 | 6 | 6.7% | |
| 4.8 | 1 | 1.1% | |
| 7 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 52.8 | 1 | 1.1% | |
| 45 | 1 | 1.1% | |
| 27.04 | 1 | 1.1% | |
| 19.3 | 1 | 1.1% | |
| 17.16 | 1 | 1.1% |
| Distinct | 5 |
|---|---|
| Distinct (%) | 9.4% |
| Missing | 36 |
| Missing (%) | 40.4% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.8726415094 |
|---|---|
| Minimum | 0 |
| Maximum | 3 |
| Zeros | 27 |
| Zeros (%) | 30.3% |
| Memory size | 712.0 B |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 2 |
| 95-th percentile | 2.75 |
| Maximum | 3 |
| Range | 3 |
| Interquartile range (IQR) | 2 |
Descriptive statistics
| Standard deviation | 1.05226706 |
|---|---|
| Coefficient of variation (CV) | 1.205841171 |
| Kurtosis | -0.843539169 |
| Mean | 0.8726415094 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 0.7997158501 |
| Sum | 46.25 |
| Variance | 1.107265965 |
| Monotocity | Not monotonic |
Histogram with fixed size bins (bins=5)
| Value | Count | Frequency (%) | |
| 0 | 27 | 30.3% | |
| 1 | 12 | 13.5% | |
| 2.75 | 7 | 7.9% | |
| 2 | 6 | 6.7% | |
| 3 | 1 | 1.1% | |
| (Missing) | 36 | 40.4% |
| Value | Count | Frequency (%) | |
| 0 | 27 | 30.3% | |
| 1 | 12 | 13.5% | |
| 2 | 6 | 6.7% | |
| 2.75 | 7 | 7.9% | |
| 3 | 1 | 1.1% |
| Value | Count | Frequency (%) | |
| 3 | 1 | 1.1% | |
| 2.75 | 7 | 7.9% | |
| 2 | 6 | 6.7% | |
| 1 | 12 | 13.5% | |
| 0 | 27 | 30.3% |
| Distinct | 2 |
|---|---|
| Distinct (%) | 11.1% |
| Missing | 71 |
| Missing (%) | 79.8% |
| Memory size | 712.0 B |
| 1 | |
|---|---|
| 2 |
| Value | Count | Frequency (%) | |
| 1 | 13 | 14.6% | |
| 2 | 5 | 5.6% | |
| (Missing) | 71 | 79.8% |
Frequencies of value counts
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Histogram of lengths of the category
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.Cramér's V (φc)
Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.First rows
| level_0 | level_1 | VendorID | lpep_pickup_datetime | Lpep_dropoff_datetime | Store_and_fwd_flag | RateCodeID | Pickup_longitude | Pickup_latitude | Dropoff_longitude | Dropoff_latitude | Passenger_count | Trip_distance | Fare_amount | Extra | MTA_tax | Tip_amount | Tolls_amount | Ehail_fee | Total_amount | Payment_type | Trip_type | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 2 | 2013-08-01 08:14:37 | 2013-08-01 09:09:06 | N | 1 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 1.0 | 0.00 | 21.25 | 0.0 | 0.0 | 0.00 | 0.0 | NaN | 21.25 | 2.00 | NaN | NaN | NaN |
| 1 | 2 | 2013-09-01 00:02:00 | 2013-09-01 00:54:51 | N | 1 | -73.952408 | 40.810726 | -73.983940 | 40.676285 | 5.0 | 14.35 | 50.50 | 0.5 | 0.5 | 10.30 | 0.0 | NaN | 61.80 | 1.00 | NaN | NaN | NaN |
| 2 | 2 | 2013-10-01 00:00:00 | 2013-10-01 15:33:36 | N | 1 | 0.000000 | 0.000000 | -73.903465 | 40.845089 | 1.0 | 0.19 | 42.00 | 0.0 | 0.5 | 0.00 | 0.0 | NaN | 42.50 | 2.00 | 1.0 | NaN | NaN |
| 3 | 2 | 2013-11-01 00:00:00 | 2013-11-01 13:48:03 | N | 1 | 0.000000 | 0.000000 | -73.937103 | 40.760647 | 2.0 | 0.00 | 3.50 | 0.0 | 0.5 | 0.00 | 0.0 | NaN | 4.00 | 2.00 | NaN | NaN | NaN |
| 4 | 2 | 2013-12-01 00:00:00 | 2013-12-01 20:44:23 | N | 1 | 0.000000 | 0.000000 | -73.957260 | 40.742355 | 1.0 | 4.00 | 13.00 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 14.00 | 2.00 | NaN | NaN | NaN |
| 5 | 2 | 2015-07-01 00:01:10 | 2015-07-01 00:19:04 | N | 1 | -73.940628 | 40.715027 | -73.912315 | 40.760380 | 1.0 | 4.33 | 15.50 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.30 | 16.80 | 2.0 | 1.0 | NaN |
| 6 | 2 | 2015-07-01 00:05:35 | 2015-07-01 00:17:42 | N | 1 | -73.951134 | 40.804947 | -73.867218 | 40.818989 | 1.0 | 6.11 | 18.00 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.30 | 19.30 | 1.0 | 1.0 | NaN |
| 7 | 2 | 2015-08-01 00:00:03 | 2015-08-01 00:00:07 | N | 5 | -73.865013 | 40.826099 | -73.864990 | 40.826099 | 1.0 | 0.00 | 7.00 | 0.0 | 0.0 | 0.00 | 0.0 | NaN | 0.00 | 7.00 | 1.0 | 2.0 | NaN |
| 8 | 2 | 2015-08-01 00:01:57 | 2015-08-01 00:02:00 | N | 2 | -73.987335 | 40.692123 | -73.987328 | 40.692123 | 1.0 | 0.00 | 52.00 | 0.0 | 0.5 | 0.00 | 0.0 | NaN | 0.30 | 52.80 | 2.0 | 1.0 | NaN |
| 9 | 2 | 2015-09-01 00:02:34 | 2015-09-01 00:02:38 | N | 5 | -73.979485 | 40.684956 | -73.979431 | 40.685020 | 1.0 | 0.00 | 7.80 | 0.0 | 0.0 | 1.95 | 0.0 | NaN | 0.00 | 9.75 | 1.0 | 2.0 | NaN |
Last rows
| level_0 | level_1 | VendorID | lpep_pickup_datetime | Lpep_dropoff_datetime | Store_and_fwd_flag | RateCodeID | Pickup_longitude | Pickup_latitude | Dropoff_longitude | Dropoff_latitude | Passenger_count | Trip_distance | Fare_amount | Extra | MTA_tax | Tip_amount | Tolls_amount | Ehail_fee | Total_amount | Payment_type | Trip_type | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 79 | 2 | 2020-02-01 00:10:25 | 2020-02-01 00:14:34 | N | 1 | 74.0 | 41.0 | 1.0 | 0.76 | 4.5 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.3 | 5.80 | 2.0 | 1.0 | 0.00 | NaN | NaN |
| 80 | 2 | 2020-02-01 00:16:59 | 2020-02-01 00:21:35 | N | 1 | 74.0 | 74.0 | 1.0 | 0.72 | 5.0 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.3 | 6.30 | 1.0 | 1.0 | 0.00 | NaN | NaN |
| 81 | 2 | 2020-03-01 00:20:18 | 2020-03-01 00:45:29 | N | 1 | 41.0 | 13.0 | 1.0 | 8.24 | 26.5 | 0.5 | 0.5 | 7.64 | 0.0 | NaN | 0.3 | 38.19 | 1.0 | 1.0 | 2.75 | NaN | NaN |
| 82 | 2 | 2020-03-01 00:15:42 | 2020-03-01 00:44:36 | N | 1 | 181.0 | 107.0 | 1.0 | 4.87 | 21.0 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.3 | 25.05 | 2.0 | 1.0 | 2.75 | NaN | NaN |
| 83 | 2 | 2020-04-01 00:44:02 | 2020-04-01 00:52:23 | N | 1 | 42.0 | 41.0 | 1.0 | 1.68 | 8.0 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.3 | 9.30 | 1.0 | 1.0 | 0.00 | NaN | NaN |
| 84 | 2 | 2020-04-01 00:24:39 | 2020-04-01 00:33:06 | N | 1 | 244.0 | 247.0 | 2.0 | 1.94 | 9.0 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.3 | 10.30 | 2.0 | 1.0 | 0.00 | NaN | NaN |
| 85 | 2 | 2020-05-01 00:27:48 | 2020-05-01 00:32:47 | N | 1 | 74.0 | 42.0 | 1.0 | 1.50 | 6.5 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.3 | 7.80 | 1.0 | 1.0 | 0.00 | NaN | NaN |
| 86 | 2 | 2020-05-01 00:39:13 | 2020-05-01 00:44:00 | N | 1 | 244.0 | 116.0 | 2.0 | 0.92 | 6.0 | 0.5 | 0.5 | 0.00 | 0.0 | NaN | 0.3 | 7.30 | 2.0 | 1.0 | 0.00 | NaN | NaN |
| 87 | 1 | 2020-06-01 00:22:07 | 2020-06-01 00:39:03 | N | 1 | 255.0 | 14.0 | 1.0 | 0.00 | 28.2 | 0.0 | 0.5 | 0.00 | 0.0 | NaN | 0.3 | 29.00 | 1.0 | 1.0 | 0.00 | NaN | NaN |
| 88 | 2 | 2020-06-01 00:09:05 | 2020-06-01 00:22:46 | N | 1 | 166.0 | 141.0 | 1.0 | 3.43 | 13.0 | 0.5 | 0.5 | 3.41 | 0.0 | NaN | 0.3 | 20.46 | 1.0 | 1.0 | 2.75 | NaN | NaN |